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Abstract 

Research indicates that increasing teacher-directed opportunities to respond 
(TD-OTK) positively impacts student outcomes. Prior reviews of the empiri¬ 
cal literature focused on outcomes for students with emotional behavioral 
disorders or on TD-OTRs a.s one of many classr<x»m-management practices; 
however. prior reviews did not examine effects of TD-OTRs solely within 
the class-wide context. For the present review, we (a) examined class-wide 
TD-OTK research (Le., screened a total of 527 unique abstracts and identi¬ 
fied, reviewed, and coded 15 empirical studies); (b) summarized the effects of 
cTass-wide ID-OTRs on student behavioral and academic outcomes, includ¬ 
ing differential impacts by modality; and (c) described the rates of TD-OTRs 
documented in the literature. Results are consistent with prior reviews, sup¬ 
porting pxvitive behavioral and academic student outcomes when clavs-wide 
TD-OTRs are increas'd, and extend the literature by identifying differential 
outcomes by modality and describing observed and desired rates of TD-OTR 

delivery. 

/ 

Keywuni.M opportunity to respond (OTR), teacher-directed opportunities to 
respond fID-OTR), review of literature, student academic achievement, stu¬ 
dent behavior 


A s the field of education continues to embrace inclusive learning 
environments, the need to support every student with a core 
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Inundation ol empirically supported academic and behavior support 
practices is acute (Conroy, Sutherland, Snyder, & Marsh, 2008; Lewis, 
Hudson, Richter, & Johnson, 2004; MacSuga-Gage. Simonsen, & Briere, 
2012; Simonsen et al.. 2010). To accomplish this goal, research supports 
setting up classroom environments that promote positive academic and 
behavioral outcomes through the application ol class-wide instructional 
and behavior support strategies (Simonsen, Fairbanks, Briesch, Myers. 
& Sugai, 2008). Within the context of empirically supported classroom 
management practices there are several categories of practices that 
improve the active engagement of all students (Simonsen et al., 2008). 
One key effective instructional practice with growing empirical support 
is providing all students with frequent and varied opportunities to 
respond (OTR. Lewis et al, 2001; Sutherland & Wehbv. 2001). 

Opportunities to respond are defined as behaviors (i.e., anteced¬ 
ent stimuli) that occasion student responses, followed by feedback 
(i.e., the consequence of engaging in the response behavior; Ferkis, 
Belfiore, & Skinner. 1997). There are multiple ways that OTR can be 
delivered to students, including by the teacher during direct instruc¬ 
tion, by peers (e.g., class-wide peer tutoring, cooperative learning 
groups), or via a mediated interface (e.g.. a computer game; Haydon, 
MacSuga-Gage, Simonsen. & Hawkins. 2012). increasingly research 
has focused on ways to provide teachers with effective training and 
in-service support around the implementation of research-supported 
classroom management practices (e.g.. Reinke, Lewis-Palmer, ii Mer- 
rell. 2008; Simonsen. MacSuga-Gage, Briere. Freeman. Myers, Scott. 
ii Sugai, 2014). This research highlights the importance of prioritiz¬ 
ing strategies that teachers can implement independently within the 
classroom setting. Thus, this review, similar to the previous review 
of OTR conducted by Sutherland and Wehbv (2001), focused exclu¬ 
sively on examining OTR that occurred as a result of direct teacher 
instruction. To that end, teacher-directed opportunities to respond 
(TD-OTR) are defined in the same context presented by Ferkis et al. 
(1997) as teacher behaviors (i.e.. antecedent stimuli) that occasion stu¬ 
dent responses. Specifically, the teacher presents a TD-OTR (i.e., the 
antecedent stimulus) to one or more students, the student(s) have a 
chance to respond, and the teacher provides feedback contingent on 
student responses. While teachers can employ a myriad of strategies 
to actively engage students (e.g., class-wide peer tutoring, computer 
assisted instruction), providing students with increased TD-OTRs is 
unique because teachers are able to alter their own teaching behavior 
during direct instruction to directly impact student outcomes. This re¬ 
view focuses on two categories of TD-OTRs. (a) teacher-directed indi¬ 
vidual responses and (b) teacher-directed unison responses. Lambert. 
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Car I ledge, Howard, and Lo (2006) describe "traditional" teadier-di- 
recled individual response as "calling on only one student to answer 
tile question while the rest of the class sits quietly and listens" (p. 89). 
Teacher-directed unison response occurs when a teacher presents a 
request to an entire group of students who are prompted to respond 
through either verbal communication (e.g., choral responding) or non¬ 
verbal communication (e.g., gestural responses such as hand raising 
or thumbs up/down; written responses, such as response cards; e.g., 
Camine, 1976; Havdon. Conroy, Scott. Sindelar, Barber. & Orlando, 
2010; Haydon & Hunter, 2011; Lambert et at. 2006). 

Reviews of empirically supported classroom-management 
practices, generally (Simonsen el at, 2008). and practices to sup¬ 
port students with school-based behavior problems, including those 
with emotional and/or behavioral disorders (F.BD. Lewis et at, 2(XH), 
summarize empirical support of positive academic and behavioral 
outcomes for students’ receiving increased classroom-management 
strategies, including OTRs. However, these reviews focus on class- 
n>om-nianagement practices generally, not TD-OTRs exclusively. 
Sutherland and VVehby (2001) focused on TD-OTRs. but exclusively 
on the relationship between increasing TD-OTRs and the academic 
and behavioral outcomes of students with EBD. 

In total, Sutherland and Wehby (2001) identified six studies that 
met all three inclusion criteria: (a) participants identified as students 
with EBD. (b) study measured the impact of increased TD-OTRs on 
student behavior or academic achievement, and (c) published in peer- 
reviewed journal. Generalization from their review is limited due to 
the small and homogenous sample of studies (four of the six studies 
were from the same research team), yet it yields important descrip¬ 
tive information about the impacts of increased TD-OTRs for students 
with EBD. Overall, findings indicate positive effects on academic 
and behavioral outcomes, including increased task engagement, de¬ 
creased disruptive behavior, and increased efficiency in the use of 
class time. Further. Sutherland and Wehby (2001) identify two studies 
(Van Acker, Grant. & Henry, 1996, Wehby. Symons, & Shores. 1995) 
that reported descriptive information about naturally occurring OTR 
rates for students with EBD. indicating that they typically received an 
average of 0.02-0.16 OTRs per minute. 

Sutherland and Wehby (2001) shed light on the effects of TD- 
OTR. however, their review (a) focused only on students with EBD. 
limiting generalization to the majority of students; (b) did not include 
detailed descriptive information about the impact by type of response 
modality (e.g.. individual responding, choral responding, response 
cards); and (c) was conducted more than a decade ago. Therefore, 
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Figure I. Systematic review process. 

an up-to-date review of (he literature examining (a) the effects of 
increased rates of TD-OTRs on outcomes for all students (with and 
without disabilities) across classroom contexts (i.e., general and spe¬ 
cial education classrooms) and (b) a review of differential effects by 
varied modalities and rates of TD-OTRs is necessary. 

Purpose of This Review 

The purpose of this literature review is to systematically exam¬ 
ine the empirical literature to assess the impact of TD-OTRs on stu¬ 
dent behavioral and academic outcomes, including differential effects 
by modality. Specifically, this review addresses the following ques¬ 
tions: 

1. What are the characteristics of the empirical literature examining 
TD-OTRs? 
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2. What are the differential effects of varying the modality of TD-OTRs 

presented on student behavior and/or academic performance? 

3. What are the differential effects of varying the rate of TD-OTRs pre¬ 

sented on student behavior and/or academic performance? 

Method 

We used a multiphase review procedure to complete a system¬ 
atic review of the literature examining TD-OTRs. Procedures included 
(a) systematic electronic database search, (b) three phases of review 
(including a forward and backward search of initially identified stud¬ 
ies). and (c) structured coding. For reference. Figure 1 provides a vi¬ 
sual representation of the systematic review pixicess. Overall, 527 ab¬ 
stracts were reviewed. 

Initial Search Procedures 

The first author performed a systematic electronic search of five 
common education databases (Academic Search Premier. ERIC. Pro¬ 
fessional Development Collection, Psychology and Behavioral Scienc¬ 
es Collection. and PsycINFO) using search terms selected from recent 
research and literature reviews (e.g., Haydon & Hunter, 2011; Simon- 
sen et al„ 2008, Sutherland & Wehby, 2001). Results from this initial 
search contained all available online references up to April 2012. To 
identify potentially relevant studies, the first author used a Boolean 
search across four inclusion criteria (separated by "AND"): (a) inter¬ 
ventions employed, (b) student and/or teacher behaviors measured, 
(c) settings, and (d) research design (please contact the first author for 
complete search terms). We set search parameters to capture scholarly 
and peer-reviewed empirical publications, excluding all technical and 
research reports that may or may not be peer reviewed (e.g.. disser¬ 
tations. technical manuals, government reports, conference presenta¬ 
tions). A total of 427 unique abstracts were identified and screened for 
inclusion during the initial search. 

Phases of Review 

We used a three-pliase review approach to identify studies for 
inclusion. 

Phase 1: Abstract renew. We conducted Phase 1 screening in three 
steps. First, the first author evaluated abstracts to determine whether 
the article was empirical or nonempirical. Empirical records included 
any record that reported the results of a quantitative research design. 
Nonempirical records included any nonexperimental records (e.g., 
reviews of literature, position papers, books, program descriptions, 
practice papers). The first author read and categorized all unique 



216 


MAC5UCA-GACE and SIMONSEN 


abstracts (k - 427) inlo empirical (k - 340) or nonempirical (k - 87). 
The 340 empirical abstracts were then passed to step 2. 

Second, the first author coded each empirical abstract (k - 340) 
across five categories for inclusion: (a) participant population (K-12 
student), (b) setting (general and special education classrooms), (c) in¬ 
dependent variables (classroom-management strategies as defined by 
Simonsen et al.. 2008, including teacher praise, TD-OTRs. and so on, 
see the note under Table 2 for a complete listing of these strategies), 
(d) dependent variables (student academic or behavioral outcomes), 
and (e) research design (group design or single subject). Abstracts 
must have met all five criteria to pass on to step 3. For example, stud¬ 
ies were excluded if the study was a case study or if the no interven¬ 
tion was investigated. A total of 91 abstracts passed initial full abstract 
review and moved to step 3. 

Third, we reviewed the 91 abstracts to determine whether the 
article focused exclusively on TD-OTR in a classroom setting. As stat¬ 
ed earlier, to align with the work of Sutherland and Wehby (2001) 
and to inform ongoing research efforts aimed at increasing teachers' 
implementation of research-based classroom management strategies, 
this review focused solely on empirical studies examining response 
opportunities directed by teachers. Specifically, studies must have ex¬ 
amined the effect of TD-OTRs on student outcomes; we excluded peer 
tutoring because the opportunity to respond is not teacher directed. 
The topic screen identified a final sample of seven studies from this 
phase of review that met all inclusion criteria. For a complete list of 
Phase 1 inclusion criteria see Table 2. 

Phase 2: Backward and foravird search. Next, we completed a back¬ 
ward and forward search (Card, 2012) of all articles included from the 
database search (k - 7). The first author examined the reference sec¬ 
tions of each included study to identify additional records not found 
in the database search. We also conducted a forward search using the 
Web of Science to identify articles citing the seven included studies. 
Tire combined backward and forward searches yielded 100 additional 
unique abstracts, which were then examined using the Pliase 1 proce¬ 
dures outlined earlier. Screening of tire 100 abstracts identified in the 
forward and backward search yielded eight additional studies eligible 
for inclusion. Thus, a total of 15 articles met all inclusion criteria, iden¬ 
tifying them for inclusion in this review’. 

Phitse 3: Full article coding. The first author then fully coded all in¬ 
cluded studies across the following categories: participant characteris¬ 
tics, criteria for participant inclusion in the study, independent variables, 
dependent variables, fidelity of implementatiorVtreatment integrity, so¬ 
cial validity, research design, modes of data analysis, and results. 
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Itilerol’sen'er agreement. We conducted interobserver agreement 
(IOA) lor 30% of all abstracts (k - 160), topic screens (k - 34), and lull 
codes (k - 5). A trained postdoctoral fellow coded all selected entries 
using the same coding procedures described earlier. A point-by-point 
comparison ol coding from the primary coder (i.e., the first author) 
and the secondary coder indicated high IOA using the agreement rate 
calculation (Orwin & Vevea. 2009): abstracts (M - 90%. range 82%- 
97%,). topic screens (M - 99%, range 93%-100%). and full codes <M - 
92%,, range 86%r-96%,). 

Results 

Characteristics of Included Studies 

A total of 15 studies focusing on class-wide TD-OTRs met all in¬ 
clusion criteria. The publication dates for the studies included ranged 
from 1968 to 2012. with six published in the past 9 years (Blood. 2010; 
Davis & O'Neill. 2004; Haydon & Hunter, 2011; Lambert el al, 2006; 
Sutherland, Alder, & Gunter. 2003). Table 1 presents detailed descrip¬ 
tions of study sample, settings, design, variables, measures, and find- 
ings. 

Student sample characteristics. Across all 15 studies, a total of 172 
students served as participants. Student grade levels were specified 
(grades 1-11 represented) for all but three of the studies (Kamps. Du¬ 
gan, Leonard. & Daoust, 1994; Sutherland et al„ 2003; Wolery. Ault. 
Doyle, & Cast. 1992), which described their sample in years of age. 
Overall, studies included students that received general education (k 
- 7) and special education (k - 8). including students with autism, in¬ 
tellectual disabilities (ID), EBD. other health impairment (OHI). learn¬ 
ing disabilities (LD), and traumatic brain injuries (TB1). 

Study settings. A variety of study settings were represented in 
this sample. The majority of studies (k - 11) took place in elementary 
settings. The rest of the studies took place in middle schools (Davis & 
O'Neill, 2034; Haydon & Hunter, 2011). one high school (Blood. 2010), 
or in unspecified public school settings (Wolery et al., 1992). Of those 
studies conducted at the secondary level (i.e.. middle and high school) 
only one focused on the general education setting, and the other two 
were conducted in special education settings (i.e., classroom instruc¬ 
tion was led exclusively by a special education teacher). Included 
studies covered a wide variety of content areas including: American 
history, English, science, language arts, functional language skilLs, 
math, geography, health, reading, and spelling. 

Study design. All but one of the studies used a single-subject de¬ 
sign. A total of eight studies employed a reversal/withdrawal design 
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or a variation (i.e., Kamps et al., 1994, used reversal/withdrawal with 
counterbalancing) of that design. Other experimental single-subject 
designs included alternating treatments (k - 4). combined alternat¬ 
ing treatment with reversal/withdrawal (k - 1 ), and a multielement 
design (k - 1). Only McKenzie and Henry (1979) employed a group 
experimental design using a random assignment with post test. 

Indcivndeiil variables. Researchers studied two categories of inde¬ 
pendent variables across all 15 studies: (a) comparison of class-wide 
TD-OTR modalities (Blood. 2010; Haydon it Hunter, 2011; Haydon et 
al., 2010; Kamps et al.. 1994; McKenzie & Henry. 1979; 5indelar, Bur- 
suck, & Halle, 1986; Wolery et al.. 1992). including response cards (Da¬ 
vis & O'Neill, 2004. Gardner, Heward. & Gross!, 1994; Lambert el al.. 
2006; Narayan. Heward. Gardner. Courson, it Omness, 1990), and (b) 
increasing class-wide rates of TD-OTR presentation (Camine, 1976; 
Sterling. Barbetta. Heward. it Heron. 1997; Sutherland et al.. 2003; 
West & Sloane, 1986). Seven studies looked at the differential effects 
of single or individual student responding versus unison responding 
(e.g.. choral responding; Haydon it Hunter. 2011; Haydon et al.. 2010; 
Kamps et al., 1994; McKenzie & Henry, 1979; Sindelar et al.. 1986; 
Sterling et al.. 1997; Wolery et al.. 1992). Within this group, the study 
conducted by Kamps and colleagues (1994) is of note because it exam¬ 
ined the impact of an OTR-rich responding package called "enhanced 
small group instruction" (i.e., choral responding, student-tostudent 
responding, frequent variation of materials, and random opportuni¬ 
ties to individually respond) with typical teacher instruction (i.e.. in¬ 
dividual presentation of OTRs at an unspecified rate). Five studies 
compared the effecLs of a single specific modality, specifically choral 
response OTRs. Of those, four examined the impact of response cards 
(Davis & O'Neill. 2004; Gardner et al.. 1994; Lambert et al.. 2006; Na¬ 
rayan et al., 1990). Response cards are either sets of preprinted cards 
with answer choices or erasable whiteboards that students can write 
on with a marker. In these studies, the teacher presented an OTR to 
the whole class and all students used their individual response cards 
to indicate an answer. Similar to the response-card strategy, one study 
(Blood, 2010) used a computerized student response system (SRS) to 
provide students with choral response opportunities. The SRS is a 
polling system that allows students to use a small handheld device 
(clicker) to respond to multiple-choice or true-false questions. Stu¬ 
dent responses are immediately displayed as a graph depicting the 
percentage of responders who chose each possible answer. Two of 
the studies compared the differential effects of researcher-selected 
TD-OTR rates (i.e., fast vs. slow presentation), and one study (Suther¬ 
land et al., 2003) asked teachers to increase their rates of OTRs to a 
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researcher-specified criterion (3.00 per minute) during intervention 
that included teacher performance feedback and graphing. 

Dependent variables. Across the 15 studies, a variety of student 
and teacher variables were assessed. Although there was slight varia¬ 
tion among student variable names (e.g.. participation and active stu¬ 
dent responding), the following 10 categories represent the student 
outcome measures collected in order of frequency: academic achieve¬ 
ment (k - 10), answering correctly (k - 9), response rate (k - 6), on- 
task behavior (k - 5), disruptive behavior (k - 4), off-task behavior (k 
- 3), active student responding (k - 2), test anxiety (k - 1), incorrect 
responses (k - 1), and no responses (k - I). Teacher variables were col¬ 
lected in less than half (k - 6) of the studies (Carnine. 1976, Gardner et 
aL, 1994; Haydon & Hunter, 2011; Kamps et al„ 1994; Narayan et al.. 
1990; Sutherland et al., 2003). These variables included (in order of fre¬ 
quency collected): teacher rates of OTRs presented (k - 4). praise state¬ 
ments (k - 2 ), redirections (k - I), and instructional statements (k - 1 ). 

Study measures of fidelity and social validity. Results of fidelity 
of implementation and social validity across studies were often not 
reported or collected. Approximately half of the studies reported 
fidelity (Blood, 2010; Haydon & Hunter. 2011; Haydon et al., 2010, 
Lambert et al., 2<X)6; Sindelar et al., 1986; Sterling et al., 1997; West & 
Sloane, 1986) and social validity (Davis & O'Neill, 2004; Haydon & 
Hunter, 2011, Haydon et al.. 2010; Kamps et al.. 1994; Lambert et al.. 
2006; Narayan et al.. 1990) data. Fidelity measures included direct ob¬ 
servation of classrooms and/or checklists. Across the studies assessing 
fidelity, teachers were able to implement interventions with fidelity 
(e.g., by meeting predetermined TD-OTR presentation rates; Kamps 
et al.. 1994). Researchers assessed social validity post-intervention us¬ 
ing researclier-created measures (e.g.. questionnaires, two-item stu¬ 
dent questions, satisfaction surveys) and interviews with teachers and 
students. Overall, social validity measures (when included/reported) 
indicated that teachers perceived greater student learning during in¬ 
creased TD-OTR conditions and students preferred increased OTRs 
to other approaches. 

Differential Effects iff Varying OTR Modality 

□even studies examined the impact of TD-OTR modality (i.e., 
how TD-OTRs were delivered to students) on student outcomes. Six 
studies examined differences between unison TD-OTRs (i.e., verbal and 
nonverbal choral response) and individual TD-OTRs. Five studies de¬ 
scribed positive outcomes resulting from various forms of implement¬ 
ing unison response (where no other formal type of response format was 
consistently present) including: increased on-task behavior (Haydon & 
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Tabic 2. 


Phase 1 Inclusion Criteria 

CatoWHV 

Indusicn Criteria 

Participant 

population 

• K-12 students (with and without disabilities! 

Selling 

• Classroom 

• Group context with 2 or more student* 


Independent 

vanoble(s) 


• Intervention focuveed on general cla»nxim 

meat (i.c., 4 or more components of evidence*bust'd doss* 
room nunj^enviU as defuvd by Simomen et aU 

• Intervention focused ixi specific practices in clossnxim 
maiu^mint (i.c., 1-3 comporents of evidence* based 
classroom management as defined by Simonscn et al.. 


Dependent variable^*! • Student outcomes (academic and behavioral) 

• Group experimental 

Research design • Group quasi experimental 

• F.xperimental single subject 

Nofr. A topic screen was coixiuctcd after the initial abstract review to determine 
if articles determined to be eligible for inclusion focused only on ways to actively 
engage students, including rates of OTRs, various types of OTRs (c£ v response 
cardsX peer tutoring models (eg. CWPT. TCFT, CLGX aixi so on. 

'Simonson et al. (IXHIb) define five critical features of evidencebascd classroom 
management that include: (a) maximizing structure, (b) post, teach, review, moni¬ 
tor, aixi reinforce a small number of positive state expectations; (c) actively engage 
students in observable ways; <d) establish a continuum of strategies to acknowl¬ 
edge appropriate behavior; and (e) establish a continuum of strategies to respond 
to inappropriate behavior. 


Hunter, 2011; McKenzie k Henry, 1979), increased active student re¬ 
sponding (Haydon el al., 2010 Kamps et al., 1994), increased academic 
achievement (Kamps et al., 1994; McKenzie k Henry, 1979; Sindelar et 
al v 1986), increased correct responses (Kamps, 1994), decreased off-lask 
behavior (Haydon et al., 2010, and decreased disruptive behavior (Hay- 
don et al.. 2010). One study, Wolery et al. (1992), found no documented 
functional relation between type of response (choral vs. individual) and 
academicor behavioral outcomes. Studies in this subsample represent¬ 
ed students in both general and special education. 

Two studies within this group explored variations on simple 
choral versus individual responding. Haydon et al. (2010) found 
llul a mixed response condition (i.e., 30% individual and 70% choral 
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TD-OTRs) resulted in slightly better outcomes than choral respond¬ 
ing alone. Kamps et al. (1994) compared the effects of an OTR-rich 
enhanced small-group instruction package (i.e., choral responding, 
student-to-student responding, frequent rotation of materials, and 
randomly selected individual student responding) on the behaviors 
of students and found that the greatest correct responses occurred 
during choral response and student-to-student response. Overall, the 
majority of the studies focusing on the comparison of unison to indi¬ 
vidual student responding support the benefits of providing all stu¬ 
dents with verbal and nonverbal choral OTRs. 

The oilier studies (k - 5) that explored TD-OTR modality focused 
on unison responses requiring students to write (i.e., response cards) 
or manually enter (i.e.. SRS) responses. All four studies comparing the 
use of response cards with traditional hand raising (i.e., single student 
responding to a question posed to the class) noted positive academic 
and behavioral outcomes for students in the response-card condi¬ 
tion, including: increased correct responses (Davis & O'Neill, 2004; 
Gardner et al., 1994), increased student responding (Gardner et al., 
1994; Lambert et al.. 2006; Narayan et al.. 1990), increased academic 
achievement (Davis & O'Neill. 2(X>4; Gardner et al., 1994; Narayan et 
al.. 1990), decreased off-task behavior (Davis & O'Neill. 2004), and de¬ 
creased disruptive behavior (Lambert et al., 2006). Three of these stud¬ 
ies occurred in the general education elementary setting. Only one 
study look place in a self-contained special education middle school 
classroom (Davis & O’Neill. 2004). Blood (2010) compared the use of 
SRS to traditional individual response on students within the general 
education setting. Although authors note increases in response rates 
for students during the use of SRS, no functional relation was detected 
for student on-task behavior or academic achievement (as measured 
by daily quizzes or end-of-phase test scores). 

Overall, evidence from studies requiring students to manually 
create their responses (i.e., response cards and SRS) mirrored findings 
of other studies examining TD-OTR modality (verbal and nonverbal 
choral responding) showing positive impacts on the behavior and ac¬ 
ademic achievement of all students with and without disabilities. Fur¬ 
ther, studies measuring social validity indicate that students reported 
favoring unison responding conditions and feeling like tliey learned 
more during those conditions (e.g., Davis & O'Neill, 2(XM; Gardner et 
al., 1994). 

Differential Effects of Varying Teacher Riites of OTR Presentation 

Four studies (Carnine, 1976; Sterling et al., 1997; Sutherland 
et al.. 2003. West & Sloane. 1986) specifically explored the impact of 
increasing rates of TD-OTRs on student outcomes. All four studies 
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found positive effects on student academic and behavioral variables 
measured as a result of faster rates of TD-OTR presentation. (Note, in 
these four studies individual students were presented with TD-OTRs 
at a faster rate versus unison response conditions present in other 
studies.) Positive results included: decreased off-task (Camine, 1976) 
and disruptive behavior (Sutherland et al.. 2003; West & Sloane, 1986) 
and increased participation (Camine, 1976), time on-task (Sutherland 
et al., 2003), correct responding (Sutherland et al., 2003; West & Sloane, 
1986). and learning of academic content (Sterling et al., 1997). Three 
were conducted in special education settings, and one took place in a 
general education setting. Overall, studies that focused on increasing 
the rate of TD-OTR presentation generally showed that faster presen¬ 
tation led to favorable outcomes for students with and without dis¬ 
abilities and that brief one-to-one skill instruction with performance 
feedback was associated with teachers increased use of this practice. 

Although none of the 15 studies focused on differential effects 
of specific TD-OTR rates (e.g., meaningful differences in student out¬ 
comes when TD-OTRs are presented at a rate of 3.00 per minute ver¬ 
sus 5.00 per minute), we were able to gamer descriptive information 
about rates of TD-OTRs presented within studies that demonstrated 
positive outcomes for students. For example, during the optimal con¬ 
dition (i.e„ active student responding). Sterling et al. (1997) presented 
students with approximately 40 TD-OTRs during a 15-minute obser¬ 
vation session, equating to an average rale of 2.67 OTRs per minute. 
Similarly, Sutherland et al. (2003) set a goal for teachers to increase 
their TD-OTR rates during intervention to 3.00 per minute, and par¬ 
ticipating teachers exceeded this criterion during intervention, pre¬ 
senting an average of approximately 3.50 TD-OTRs per minute (from 
a naturally occurring mean of 1.68 per minute during baseline). West 
and Sloane (1986) increased response rates by varying how many TD- 
OTRs teachers presented per minute. In the fast condition, teachers 
presented approximately 4.00 OTRs per minute. Descriptive informa¬ 
tion from these four studies indicates that desired student outcomes 
occurred with the presentation of approximately 3.00-5.00 TD-OTRs 
per minute. 

Studies examining unison versus individual responding ranged 
in OTR presentation rates, yet choral responses greatly increased the 
overall number of opportunities available for each individual student 
to respond. Treatment integrity data from Haydon et al. (2010) showed 
that all teachers were able to implement OTRs across conditions with 
an average rate of approximately 4.50-5.00 per minute. Similarly, 
teachers in Haydon and Hunter's (2011) study met or exceeded the 
3.00 per minute criterion. In the study by Kamps and colleagues (1994), 
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individual OTRs for each student increased on average during the en¬ 
hanced small-group instruction condition from less than 1.(0 per min¬ 
ute to approximately 1.50 per minute or more. The findings from these 
studies demonstrate positive student outcomes for verbal or nonverbal 
(i.e., gestural) choral response at a rate similar to individual student 
response (i.e., 3.00-5.00 TD-OTRs presented per minute). 

Across the studies assessing the impact of response cards and 
the SRS. OTR rates reported are relatively similar between individual 
and unison responding conditions. Despite this general similarity, a 
slight decrease in OTR presentation is noted during unison respond¬ 
ing conditions. However, as noted earlier, during unison responding 
all students were presented with a chance to respond, so the overall 
number of responses per student was greater. During response-card 
conditions, researchers noted varying rates of TD-OTRs, ranging from 
0.89 (Lambert el al„ 2006) to 1.20 per minute (Blood. 2010; Narayan 
et at, 1990). with one study reporting a moderate rate of 0.99 per 
minute (Gardner et al.. 1994). Overall. TD-OTR rates ranged from ap¬ 
proximately 3.(X) to 5.00 per minute for studies focused on increasing 
the rate of TD-OTR presentation or those employing verbal or ges¬ 
tural unison response modalities. In contrast to the studies examining 
increased rates of TD-OTR presentation and unison response, studies 
that required students to manually generate a response (i.e., write or 
type a response), provided lower rates of opportunities to respond 
(i.e., approximately 1.00 per minute). When interpreting these results 
it is important to note that studies at the secondary level are lacking, 
and differences in elementary and secondary curriculum may affect 
optimal rates of TD-OTRs in those settings. Similarly, research has not 
documented optimal OTR rates for various formats (e.g.. drill format) 
and content areas (e.g., mathematics versus science) of instruction. 

Discussion 

This review of literature sought to answer three distinct ques¬ 
tions about class-wide TD-OTRs research. The discussion of results is 
framed around each individual question. 

Whal Are Ihe Characteristics of the Empirical Literature Examining Ciass- 
Wide TD-OTRs.’ 

This systematic review yielded a sample of 15 studies, nine more 
than Sutherland and Webby's (2001) review. Although the literature 
base remains limited in size, studies included a relatively equivalent 
representation of studies focusing on students with (k - 8) and without 
(k - 7) disabilities. Given the variety of students included in the sample 
and Ihe associated positive outcomes, implementing increased and 
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varied TD-OTRs in a class-wide setting appears supported. Although 
student disability status (ix>., special education status or general edu¬ 
cation status) was similar across studies, there was little variation in 
the school level of study settings. Only three studies represented high 
school (k - 2) and middle school (k - 1). However, these studies did 
demonstrate positive student outcomes. Similarly, the majority of the 
12 studies conducted at the elementary level also yielded positive re¬ 
sults. The over representation of elementary settings presents a restric¬ 
tion on the generalizability of outcome results across settings, but gen¬ 
erally indicates positive results in elementary schools and tentatively 
positive results in middle and high schools. Further research across 
varied contexts including secondary and alternative school settings is 
needed. 

Whal Are Ihe Differential Effects of Varying the Modality of TD-OTRs 
Presented on Student Behavior and/or Academic Performance? 

Results of this review indicate that providing students with 
class-wide unison TD-OTRs (i.e., verbal and nonverbal choral re¬ 
sponse opportunities) results in more positive academic and behav¬ 
ioral outcomes for students with and without disabilities than indi¬ 
vidual TD-OTRs. This finding echoes those of Si monsen et al. (2008), 
confirming that unison response modalities lead to more positive 
student outcomes. Although studies did not compare specific modes 
of unison responding (e.g.. gestural choral responses versus response 
cards), the majority of studies within this sample suggest that any 
type of unison response format may be more effective than individual 
responding. Thus, future research should focus on exploring whether 
differences exist between different modalities of unison TD-OTRs. 

Finally, only one study in tire sample (Haydon et al., 2010 empiri¬ 
cally tested the differential effects between mixed responding (i.e., 30% 
individual responding. 70% choral responding) and single modality 
response conditions (i.e., choral response only or individual response 
only). This study found that conditions containing choral response 
always lead to greater student gains than individual responding only, 
but that mixed responding was slightly more effective. The findings of 
Haydon et al. (2010) and Kamps et al. (1994) suggest that combining 
various types of TD-OTRs may positively impact student outcomes. 
To date these are the only two studies comparing different modalities. 
Further research is needed to determine the optimal combinations of 
TD-OTR modalities that lead to positive student outcomes. In sum, 
providing all students with class-wide unison TD-OTRs appears to 
lead to positive student outcomes. Although there may be differential 
impacts based on modality of unison response (i.e.. response cards 



TEACHER-DIRECTED OPPORTUNITIES 


233 


vs. gestural responding) or the combination of modalities employed, 
tliese differences I rave not been examined. 

What Are Ihe Differential Effects of Varying the Rate ofTD-OTRs Present¬ 
ed on Student Behavior and/or Academic Performance? 

All studies exploring the impact of increasing the presenta¬ 
tion rate of TD-OTRs demonstrated positive outcomes for students 
with and without disabilities, including: (a) decreases in off-task and 
disruptive behavior and (b) increases in correct responses, student 
participation, and on-task behavior. These findings mirror those of 
Sutherland and Wehby (2001) and support the findings of Lewis et al. 
(2004) and Simonsen et al. (2008). Due to the limited number of stud¬ 
ies in this review and in prior reviews and the lack in variety of exper¬ 
imental designs employed, the continued investigation of increased 
rates of class-wide TO-OTRs is necessary. 

In addition to understanding the impact of increased teacher 
presentation and various modalities of TD-OTRs on student out¬ 
comes, the literature has not identified the optimal rate of TD-OTRs 
for effective classroom management. To date, no studies have con¬ 
clusively examined differential effects of specific rates of TD-OTRs or 
the possibility of ceiling effects (i.e., saturation), particularly within 
the context of class-wide delivery. Sutherland et al. (2003) detail the 
guidelines outlined by the Council for Exceptional Children (CEC) in 
their 1987 report of best practices for teachers of students with high- 
incidence disabilities: 

During instruction of new material, teachers should elicit four 
to six responses per minute from students, who should in 
turn respond with 80% accuracy. During independent prac¬ 
tice, students should make 8—12 responses per minute, with 
90% accuracy (CEC, 1987). Eliciting frequent responses from 
students allows the teacher to adjust the lesson based on stu¬ 
dent feedback, increase the quality of the lesson, and increase 
the attentiveness of students, (p. 240) 

Tliese guidelines, which were among the first and only publislted 
recommendations for the desired rate of TD-OTRs, suggest a rate of 
approximately 8.00-12.00 OTRs per minute. Yet. it is important to note 
tliat this recommendation refers to teachers of students with high- 
incidence disabilities typically teaching functional communication or 
basic fact concepts (e.g., letter and number identification) in a drill 
format. Therefore, this rate may be too high for teachers providing 
other types of class-wide direct instruction. 

Results of this review identified that TD-OTR rates during direct 
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instruction of basic facts (e.g., the presentation of flash cards with sight 
words) during optimum conditions (i.e.. the response condition asso¬ 
ciated with positive student outcomes) ranged from approximately 
3.00 to 5.00 TD-OTRs per minute. These rates fall below the guidelines 
set fourth by the CEC (1987). One reason for this may be that different 
populations of students (i.e., students w ithout disabilities or students 
with other types of disabilities) participated in these studies. Howev¬ 
er. since positive impacts were noted for students receiving drill-style 
instruction within these studies, it may be that slightly lower rates 
than suggested by the CEC are still optimal. This is a cautious recom¬ 
mendation, as the aim of these studies was not to establish an optimal 
rate. Thus, future research should compare the differential impacts of 
TD-OTR rates during drill instruction. 

Stichter, Lewis. Richter, Johnson, and Bradley (2006) suggest¬ 
ed an optimal rate of 3.5 TD-OTRs per minute during active direct 
instruction. To confirm their re-commendation. Stichter et al. (2009) 
conducted a descriptive study to examine teachers' classroom-man¬ 
agement procedures and instructional practices associated with TD- 
OTRs. A total of 35 classrooms across four elementary schools partici¬ 
pated in the study. They found that the average TD-OTRs was 2.62 
per minute (1.95-3.27 OTRs per minute). These results indicate that 
naturally occurring rates of TD-OTRs in the general education setting 
may approximate, yet fall slightly below, 3.50 per minute. 

Further, several studies in this review demonstrated that teach¬ 
ers were able to either meet or exceed a rate of 3.00-3.50 OTRs per 
minute using either increased presentation or unison response (e.g., 
Haydon it Hunter, 2011; Sutherland el al., 2003). and positive out¬ 
comes occurred at these rates. However, in conditions where students 
used unison response modalities that required writing (i.e., response 
cards) or the use of a clicker (i.e., SRS) response rates ranged from 0.89 
to 1.20 per minute. Similar to the studies with higher response rates, 
these studies also indicate improved student outcomes. Tlierefore, it 
may be possible that depending on the modality of student respond¬ 
ing. a slower presentation rate is as effective as a faster presentation 
rate. Again, this review yields only descriptive information, and fu¬ 
ture research should focus on establishing how many TD-OTRs are 
optimal for each modality. 

Limitation* 

There were three major limitations to this review. First, although 
we used a replicable systematic review process to identify eligible 
material across multiple electronic databases in conjunction with 
backward and forward searches, it is possible that relevant studies 
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were not reviewed. The initial database search yielded lew studies, 
presumably as a result ol the restrictive Boolean search; however, the 
addition of the backward and forward search increased the likelihood 
that the search was comprehensive. Still, some relevant studies may 
have been missed. 

Second, no measure of study quality was used to evaluate key 
study components (e.g., strength of experimental design, appropri¬ 
ate measurement, inclusion of social validity measures). However, the 
goal of this review was to yield descriptive information about the cur¬ 
rent literature base, not evaluate the quality of live empirical evidence. 
Due to the relatively small sample size (k - 15), exclusion of studies 
based on quality would have minimized the ability to garner mean¬ 
ingful information from the literature base. Thus, as the research base 
grows, future reviews of literature should focus on the inclusion of 
study quality measures. 

Finally, with the exception of one study (McKenzie & Henry, 
1979), all studies in the sample employed a single-subject research 
design and the majority of studies occurred in elementary school set¬ 
tings. Thus, further research across varied contexts, especially at the 
middle and high school level, as well as different study designs (e.g., 
experimental group design) would help to diversify the empirical sup¬ 
port for increasing rates and modalities of opportunities to respond 
and provide causal evidence of increased TD-OTR effectiveness. 

S/iggcsfions for Practice 

Findings of this review have practical implications for teachers 
educating all students within general and special education classroom 
settings. Most importantly, studies confirm that how teachers deliver 
OTRs may impact students' academic achievement and beltavior. Re¬ 
search suggests that by increasing the rate of TD-OTR presentation 
and varying the modality, teachers can support student gains regard¬ 
less of disability status. To increase the rate of OTRs presented, teach¬ 
ers should target periods of direct instruction when they are review ¬ 
ing basic facts or concepts and increase the number of OTRs presented 
to students to multiple times per minute (i.e., a rate of approximately 
3.00-5.<X) OTRs per minute). To increase the number of chances each 
student is able to respond, teachers can employ unison response 
modalities, such as choral response using gestures (e.g., thumbs up/ 
down, hand raising), response cards, or computer-assisted respond¬ 
ing (e.g.. the SRS). These response modalities can easily replace ex¬ 
isting traditional responding by simply varying the modality of the 
questions that the teacher typically asks during direct instruction. 
When using unison response modalities requiring students to write 
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(i.e., response cards), Ihe rale of TDOTRs presented may decrease to 
1.00 per minute to give students ample time to answer. 

Conclusion 

This review extends the support for TD-OTRs as an effective 
class-wide management strategy resulting in increased academic 
achievement and desired changes in student behaviors (e.g., Conroy 
et at, 2008; Lewis et at, 2004; Simonsen et at, 2008). Although further 
research Ls needed to examine the effects of increasing class-wide TD¬ 
OTRs across relevant contexts and to determine the differential effects 
of TD-OTR modalities, the current empirical evidence supports posi¬ 
tive academic and behavioral outcomes of increased TD-OTRs across 
students with and without disabilities. 
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